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Abstract 

If A is an n-by-n matrix over a field F [A € M n (F)), then A is 
said to "have an LU factorization" if there exists a lower triangular 
matrix L € M n (F) and an upper triangular matrix U G M n {F) such 
that 

A = LU. 

We give necessary and sufficient conditions for LU factorability of a 
matrix. Also simple algorithm for computing an LU factorization is 
given. It is an extension of the Gaussian elimination algorithm to the 
case of not necessarily invertible matrices. We consider possibilities 
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to factors a matrix that does not have an LU factorization as the 
product of an "almost lower triangular" matrix and an "almost upper 
triangular" matrix. There are many ways to formalize what almost 
means. We consider some of them and derive necessary and sufficient 
conditions. Also simple algorithms for computing of an "almost LU 
factorization" are given. 

If A is an n-by-n matrix over a field F (A G M n (F)), then A is said 
to "have an LU factorization" if there exists a lower triangular matrix L G 
M n (F) and an upper triangular matrix U G M n (F) such that 

A = LU. 

Historically, such factorizations have been extensively used in the solution of 
the linear system Ax = b, especially when a series of right hand sides b is 
presented. For, if A = LU, then each solution a; is a solution to 



for some solution y to 



Ux = y 



Ly = b, 



and if L is invertible, y is uniquely determined; and if U is invertible, any 
solution y to Ly = b will give a solution x to Ax = b via Ux = y. Thus, 
much of the discussion of LU factorization has occurred in the computational 
literature . However, LU factorization has also emerged as a useful theoretical 
tool. 

Though an LU factorization is quite useful when it exists, unfortunately 
not every matrix has one. The simplest example is 



A 



1 

1 



If A = LU 
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then L and U would have to be 



Mil Un 
U 2 2 

invertible because A is (i.e. In, un, I22, U22 7^ 0), but this would contradict 
l n u n = a n = 0. 

Which A G M n (F), then, do have an LU factorization? We first observe 
a necessary condition on A by writing a supposed factorization in partitioned 
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A21 A22 



form. Suppose 

with An k-by-k, and that 

A = 

partitioned conformally. We then have 

[A n A 12 ] =L u [UuU 12 ] 

and 



" Ln 
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and 



An = L U U : 
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We use well known inequalities involving ranks of products. If Z = XY with 
X having k columns and Y having k rows, 

rankX + rankY — k < rankZ < min{rankX, rankY} 

First applying the right hand inequality we have 

rank[AnAi2] < rankLn 

and 



rank 



An 
A 2 i 



< rankUn 



Then applying the left hand inequality we get 

rankLn + rankUn — k < rankAn 
Combining, we obtain 



rank[AnAi 2 ] + rank 



An 
A 2 i 



— k < rankAn 
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which we may write as 

rankAu + k > rank[AiiAi 2 ] + rank 

this must hold for each k — 1, . . . , n — 1. We can also write these conditions 
as 

rankA{{\ ...k}] + k> rankA[{\ ... k}, {1 ... n}] + rankA[{\ ... n}, {1 ... k}] (1) 

for all k — 1, . . . , n. 

Our main result is that these conditions are also sufficient. 

Theorem 1 The matrix A = (a^) G M n (F) has an LU factorization iff it 
satisfies conditions (1). 

Proof. Necessity was proved above. We will prove sufficiency by induction 
on n. In the case n = 1 the theorem is trivially true because any 1-by-l matrix 
has an LU factorization. In particular, if A = [0] we let L = [0] and U — [0]. 
Though there are many other LU factorizations of the zero matrix we choose 
this particular one for the purposes of theorem 5. 

Suppose that conditions (I) are sufficient for n < m. We want to prove 
that conditions (I) are also sufficient for n — m + 1. 

The idea of the proof is as follows. We want to find a lower triangular 
matrix L and an upper triangular matrix U such that A = LU. Suppose 

in which an is the (1,1) entry of A, and that 

un U12 
U22 

partitioned conformally. 

Block multiplication gives us 

an = l u u n 

A 2 i = L 2 iu u 

A\2 = hiUu 

A22 — L21U12 + L22U22 



A21 



A = LU = 



hi 
L21 





L22 



(2) 
(3) 
(4) 
(5) 
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We will prove that it is possible to choose the first column of L and the 
first row of U in such a way that equations 2-4 are satisfied and additionally 
that the (n-l)-by-(n-l) matrix 



B = A 



22 



L21U12 



satisfies the conditions (1). We call B "a factor complement" of A. Then 
by the inductive hypothesis matrix B has an LU factorization or B = LqUq 
with Lq lower triangular and Uq upper triangular. We let 



-^22 — -^0 

and 

U22 = U . 

Notice that a matrix L defined this way is lower triangular, and a matrix U 
defined this way is upper triangular. Also equations 2-5 are satisfied which 
implies that A = LU. 

We will now describe how to choose the first column of L and the first 
row of U. We need to consider several cases. 

Case 1: a n ^ 0. In this case we let 

L[{l...n},{l}]=A[{l...n},{l}] 

and 

[/[{!}, {l...n}]=arM{l},{l...n}] 



which gives us 



hi 
L21 
un 
U 12 



an 
A 2 i 
1 

a^A 



12- 



Equations (2)-(4) are obviously satisfied by this choice of the first column of 
L and the first row of U. It remains to prove that the matrix B = A22—L21U12 
satisfies conditions (1). 

Let us consider the matrix 



C = A- 



a n 
L21 



[0 U 



12 



an 







an 


" 


A21 


A 2 2 — L21U12 




_ A 2 i 


B 



(6) 
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Matrix C satisfies conditions (1). Indeed, let us fix k (1 < k < n). Then 
matrix C[{1 . . . k}] can be obtained from matrix A[{1 . . . k}] by applying 
several type-3 elementary column operations. Therefore 

rankC[{l . . . k}] — rankA[{\ . . .k}]. 

In particular, 

rankC = rank A 

Similarly, 

rankC[{l . . . k}, {1 . . . n}} = rankA[{l . . . k}, {1 . . . n}] 

and 

rankC[{\ ... n}, {1 ... k}} = rankA[{\ ...n},{l... k}]. 

Since A satisfies conditions (1) we conclude that C also satisfies conditions 
(!)■ 

From the formula (6) it now follows that matrix B satisfies conditions 
(1). Indeed, let us fix k (1 < k < n — 1). Because Cn = On ^ and 
Cu — • • ' — c\,k+i = we have 

rankC[{l . . . n}, {2 . . . k + 1}] = rankC[{l ... n}, {1 ... k + 1}] - 1 

Also because Ci 2 = • • • = Ci^+i = we see that 

rankC\{\ ... n}, {2 ... k + 1}]] = rankC[{2 ... n}, {2 ... k + 1}], 

but C[{2 . . . n}, {2 . . . k + 1}] = B[{1 . . . n - 1}, {1 . . . k}} and therefore 

rankB\{\ ... (n - 1)}, {1 ... k}} = rankC[{l ... n}, {1 ... (k + 1)}] - 1 (7) 

Similarly, 

rankB\{\ ... k}, {1 ... (n - 1)}] = rankC\{\ . . . (k + 1)}, {1 . . .n}} - 1 (8) 
rankB\{\ ...k}]= rankC\{\ . . . (k + 1)}] - 1 (9) 

In particular, 

rankB = rankC — 1 = rank A — 1 
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Also since C satisfies conditions (1) we have 



rankC[{l . . . (k + 1)}] + (jfc + 1) > rankC[{l . . . (k + 1)}, {1 . . .n}] + 

rankC\{\ ... n}, {1 ... (Jfc + 1)}]. (10) 

From (7)-(10) we conclude that 

rankB[{\ ...k}] + k > rankB[{l ... A:}, {1 ... (n - 1)}] + 

rankB[{l...(n-l)},{l...k}\. 

In other words B satisfies conditions (1). 

Case 2: an = 0. If an = 0, then conditions (1) for k — 1 imply that 
either the first row or the first column of A or both are zero. We first consider 
the case when the first row of A is equal to zero but the first column is not 
zero. Let i be the smallest integer such that a u ^ 0. We let 



and 

which gives us 



L[{l...n},{!}] 
[/[{!}, {l...n}] = 



= A[{l...n},{l}] 
a u 1 A[{z},{l...n}] 



hi = 
L21 = A21 

Ull = 1 

U 12 = a^A[{i},{2...n}} 

Again equations (2)-(4) are obviously satisfied by this choice of the first 
column of L and the first row of U. It remains to prove that the matrix 
B = A 2 2 — L21II12 satisfies conditions (1). 

Let us consider the matrix 



C = A 





L21 



[0 u 12 ] = 














" 


A21 


A22 — L21U12 




_ A21 


B 



(11) 



Exactly as in case 1 we prove that matrix C satisfies conditions (1), and 

rankC = rankA 



7 



From the formula (11) it now follows that matrix B satisfies conditions 
(1). Indeed, let us fix k (1 < k < n — 1). Because Qi = an ^ and 
Ci2 = ■■■ = Q,fe+i = we have 

rankC[{l . . . n}, {2 . . . k + 1}] = rankC\{\ . . . n}, {1 . . . k + 1}] - 1 

Also because cyi = ■ ■ ■ = c^k+i = we see that 

rankC\{\ ... n}, {2 ... k + 1}] = rankC[{2 ... n}, {2 ... k + 1}], 

but C[{2 . . . n}, {2 . . . k + 1}] = B[{\ . . . n - 1}, {1 . . . jfc}] and therefore 

rankB\{\ ... n - 1}, {1 ... k}] = rankC[{l ... n}, {1 ... jfc + 1}] - 1 (12) 

If + 1 > % similar reasoning gives 

rankB\{\ . . . k}, {1 . . . (n - 1)}] = rankC[{l ... (k + 1)}, {1 ... n}} - 1 (13) 
rankB[{l . . . k}] = rankC[{l . . . (k + 1)}] - 1 (14) 

In particular, 

rankB = rankC — 1 = rank A — 1 
But if k + 1 < i we have 

rankB\{\ . . . k}, {1 . . . (n - 1)}] = ranfcC[{l . . . (jfc + 1)}, {1 ... n}} (15) 
rankB[{\ ...k}} = rankC[{l ...(k+ 1)}] (16) 

Also since C satisfies conditions (1) we have 

rankC[{l . . . (k + 1)}] + (jfc + 1) > rankC[{l . . . (k + 1)}, {1 . . . n}} + 

rankC[{l...n},{l...(k+l)}}.(17) 

From (12)-(17) we conclude that 

rankB[{\ . . .k}] + k > rankB[{\ . . . k}, {1 . . . (n - 1)}] + 

rankB[{l . . . (n - 1)}, {1 . . . k}]. 

In other words B satisfies conditions (1). 

We now consider the case when the first column of A is zero, but the first 
row is not zero. We let 

C = A T 
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Notice that C satisfies conditions (1) and also the first row of C is zero, but 
the first column of C is not zero. It was shown above that there are scalars 
rriu, an d v u and a column vector M 2 i and a row vector Vi 2 such that 

en = an = rriuVu 
C 2 i = A T l2 = M 21 v u 
C12 = = mn Vi 2 

and additionally that matrix 

C 22 — M 2 iVi 2 

satisfies conditions (1) and 

rank{C 22 — M 2 iVi 2 ) = rankC — 1 = rankA — 1 

We now let 



hi 


= Vu 


L 2 i 


= v? 2 


Uu - 


= mu 


Ui 2 ~- 





Equations (2)-(4) are obviously satisfied by this choice of the first column of 
L and the first row of U . Additionally a factor complement of A 

B = A 22 — L 2 iUi 2 = (C 22 — M 2 iVi 2 ) T 

satisfies conditions (1) and also 

rankB = rank(C 22 — M 2A Vi 2 ) = rankA — 1 

The last case we have to consider is when both the first row and the first 
column of A are equal to zero. If A is the zero matrix we let the first column 
of L and the first row of U to be equal zero. Equations (2)-(4) are obviously 
satisfied by this choice of the first column of L and the first row of U. Also 
matrix 

B = A 22 — L 2 iUi 2 
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is the zero matrix and therefore obviously satisfies conditions (1). In this 

case 

rankB = rankA = 

If A is not the zero matrix let i be the smallest integer such that the iih 
column of A is not zero. Let us consider the matrix C such that the first 
column of C is equal to the zth column of A and columns 2 through n of 
C are equal to the corresponding columns of A. We want to prove that C 
satisfies conditions (1). Fix k (1 < k < n). If k is less than i then because 
the first row of C is zero we have 

rankC[{l...k},{l...n}\ < k - 1 

and because columns 2 through k of C are zero, but the first column of C is 
not zero we have 

rankC[{l...n},{l...k}] = 1 

We conclude that 

rankC[{l ...k}] + k> rankC[{\ ...k},{l... n}]+rankC[{l ... n}, {1 ... k}} 

which means that C satisfies condition (1) for index k. 

If k is greater or equal than i, then because columns 2 through n of C are 
equal to the corresponding columns of A and the first column of C is equal 
to the ith column of A and also because the first column of A is zero we have 

rankC[{l ...k}}= rankA\{\ ...k}} 

In particular 

rankC = rankA 

Also 

rankC[{\ . . . k}, {1 . . . n}} = rankA[{l ... k}, {1 ... n}} 

and 

rankC[{l . . . n}, {1 . . . k}} = rankA[{l ... n}, {1 ... k}} 

Since A satisfies conditions (1) for index k, we conclude that C satisfies con- 
ditions (1) for index k. We already know that because C satisfies conditions 
(1) and the first row of C is zero, but the first column of C is not zero there 
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are scalars ran, and vn and a column vector M 2 i and a row vector V12 such 
that 

en = = mn^ii 
C 2 i = M21V11 
C12 = i4 w = miiK 2 

and additionally that matrix 

C22 — -^21^12 

satisfies conditions (1) and 

rank{C 22 — M 21 Vi 2 ) = rankC — 1 = rankA — 1 

We now let 

in = 
L 2 i = M 2 i 
u u = 

u 12 = v 12 

Equations (2)-(4) are obviously satisfied by this choice of the first column of 
L and the first row of U. Additionally a factor complement of A 

B = A 22 — L 2 \U\ 2 = C 22 — M 2 ]V\ 2 

satisfies conditions (1) and also 

rankB = rank(C 22 — M 21 V 12 ) = rankA — 1 

Note that this case can also be treated by considering matrix C such that 
the first row of C is equal to the first nonzero row of A and such that rows 
2 through n of C are equal to the corresponding rows of A. □ 
We now prove the following well known result 

Corollary 1 Let A be an n-by-n invertible matrix then A has an LU factor- 
ization iff all principal leading submatrices of A have full rank. 
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Proof. Since A is invertible we must have 

rankA\{\ ... k}, {1 ... n}] = rankA\{\ . . . n}, {1 . . . k}} = k 
for all k — 1, . . . , n. Then by theorem (1) A has an LU factorization iff 

rankA[{\ ...k}] = k 

for k — 1, . . . , n □ 

We now give pseudo-code description of the algorithm derived in theorem 
(1) for finding L and U. 

Algorithm 1 

Input n-by-n matrix A 
for k from 1 to n 
for i from 1 to n 
for j from i to n 

if dij ^ 

kth column of L:= jth column of A 

kth row of U:=a~j multiplied by ith row of A 

GOTO 10 

elseif dj-i 7^ 

kth column of L:= ith column of A 

kth row of XJ:=a~l multiplied by jth row of A 

GOTO 10 

endif 

endif 

next j 

next i 

A;th column of L:= the zero vector 
A;th row of U:=the zero vector 

10 A=A-(Mh column of L multiplied by kth row of U) 
next k 

We also give a verbal description of the algorithm: 
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1) Assign priorities to all possible positions in n-by-n matrix. 
For all k from 1 to n repeat steps 2 through 4 

2) Find a nonzero element of matrix A which has the smallest possible 
integer assigned to its position. If there are no nonzero elements (i.e if A is 
the zero matrix) then let kth column of L and kth row of U equal to zero 
and skip to step 4. 

3) Suppose the element chosen in step 2 is in position (i,j) then let A;th 
column of L equal to jth column of A and kth row of U equal to ith row of 
A divided by a^. 

4) Let 

A = A - L[{1 . . .n},{k}]U[{k},{l . . .n}] 

How to assign priorities? 
We give a simple pseudo-code description and a 4-by-4 example 
let counter=0 
for i from 1 to n 
for j from i to n 
counter =counter+ 1 

assign value of counter to (i,j) and (j,i) positions 
next j 
next i 

Here is how we would assign priorities to positions in 4-by-4 matrix 



" 1 


2 


3 


4 " 


2 


5 


6 


7 


3 


6 


8 


9 


. 4 


7 


9 


10 . 



We may now state 

Theorem 2 A e M n (F) has an LU factorization iff algorithm (1) produces 
LU factorization of A. 

Proof. Necessity. If A has an LU factorization then by theorem (1) it satisfies 
conditions (1). Then the algorithm will produce an LU factorization of A. 
Sufficiency is trivial. □ 
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Note 1 



Suppose that an n-by-n matrix A satisfies conditions (1) and additionally the 
first m rows of A are equal to zero and the first m columns of A are zero. If 
we apply the algorithm to obtain an LU factorization of A, then the first m 
rows of L will be equal to zero and the first m columns of U will be zero. 

Note 2 

It was shown in the proof of the theorem (1) that when we perform one 
step of the algorithm (i.e. go from k=p to k=p+l) the rank of modified A 
is less by one than the rank of A before modification, unless the rank of A 
before modification was already zero. So if we start with an n-by-n matrix 
A satisfying conditions (1) such that rank deficiency of A is m, then after 
(n-m) steps modified A will be the zero matrix. Therefore the last m columns 
of L and the last m row of U will be equal to zero (which means that the 
algorithm produces "full rank" factorization of A). In particular, if A has m 
rows of zeros or m columns of zeros, then the last m columns of L and rows 
of U are zero. 

Note 3 

By previous note the ranks of L and U are less or equal to (n-m). But 
they also must be greater or equal than the rank of A which is equal to (n-m). 
Therefore rankL = rankU = n — m. 

Definition 1 An n-by-n matrix K is said to be an almost lower triangular 
with m extra diagonals if a(i,j) = whenever j > i + m. An almost upper 
triangular matrix with m extra diagonals is defined similarly. 

Definition 2 We say that an n-by-n matrix A fails conditions(l) by at most 
(no more than) m if 

rankA[{\ . . . k}]+k+m > rankA[{\ . . . k}, {1 . . . n}]+rankA[{l . . . n}, {1 . . . k}] 
for all k — 1, . . . , n. 

Given an n-by-n matrix A we obtain (n+m)-by-(n+m) matrix C by bor- 
dering A with m columns of zeros on the left and m rows of zeros on the 
top. 

We state a trivial but useful lemma 
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Lemma 1 If A and C are as above then C satisfies conditions (1) iff A fails 
conditions (1) by no more than m. 

We now prove 
Theorem 3 A e M n (F) can be written as 

A = KW 

where K is an almost lower triangular matrix with m extra diagonals and 
W is an almost upper triangular matrix with m extra diagonals iff A fails 
conditions (1) at most by m. 

Proof. Sufficiency. Given an n-by-n matrix A that fails conditions (1) by 
no more than m we obtain (n+m)-by-(n+m) matrix C by bordering A with 
m columns of zeros on the left and m rows of zeros on the top. Matrix C 
satisfies conditions (1). We apply the algorithm to obtain LU factorization 
of C. As was noted above the first m rows and the last m columns of L are 
zero. Also the first m columns and the last m rows of U are zero. We let 

K = L[{m + 1 . . . n + m}, {1 . . . n}] 

and 

W = U[{1 . . . n}, {m + 1 . . . n + m}\ 

Matrices K and W defined this way have the desired form. Also block 
multiplication shows that 

A = KW 

Necessity. Suppose A can be written as 

A = KW 

with K and W such as above. We define C, L and U as above. Block 
multiplication shows that 

C = LU 

Therefore by theorem (1) C satisfies conditions (1). It follows that A fails 
conditions (1) by no more than m. □ 
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Note 4 



If matrix A has rank deficiency p then matrix C defined as above has rank 
deficiency m + p and by note (2) the last m + p columns of L and rows of 
U are equal to zero. Therefore the last p columns of K are zero and the 
last p rows of W are zero. In particular our algorithm produces a full rank 
factorization of A. 

Note 5 

Notice that algorithm (1) when applied to matrix C such as above simply 
"ignores" first m zero columns and first m zero rows. Therefore matrices K 
and W can be obtained by applying algorithm (1) to matrix A directly and 
then letting 

K = L 

and 

W = U 

We now state 
Theorem 4 An n-by-n matrix A can be written as 

A = KW 

where K is an almost lower triangular matrix with m extra diagonals and W 
is an almost upper triangular matrix with m extra diagonals iff' the algorithm 
described in note (5) produces such a factorization. 

Proof. Suppose A has such a factorization then by theorem (3) it fails con- 
ditions (1) by no more than m. Then the algorithm produces a factorization 
of desired form. Sufficiency is obvious. □ 

Definition 3 An n-by-(n+m) matrix H is said to be an almost lower trian- 
gular with m extra columns if the matrix H[{1 . . . n}, {m + 1 . . . n + m}] is 
lower triangular. An (n+m)-by-n matrix W is said to be an almost upper 
triangular with m extra rows if the matrix W[{m + 1 . . . n + m}, {1 . . . n}] is 
upper triangular. 
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Theorem 5 An n-by-n matrix A can be written as product of an almost 
lower triangular matrix H with m extra columns and an almost upper trian- 
gular matrix V with m extra rows iff A fails conditions (1) by no more than 
m. 

Proof. 

Necessity. Suppose A can be written as 

A = HV 

with H and V such as above. We obtain an (n+m)-by-(n+m) matrix C by 
bordering A with m rows of zeros on the top and m columns of zeros on the 
left. We obtain a lower triangular matrix L by bordering H with m rows of 
zeros on the top, and an upper triangular matrix U by bordering V with m 
columns of zeros on the left. Block multiplication shows that 

C = LU 

Therefore by theorem (1) C satisfies conditions (1). It follows that A fails 
conditions (1) by no more than m. 

Sufficiency. Suppose A fails conditions (1) by no more than m. We 
define matrix C as above. Matrix C satisfies conditions (1). We now apply 
algorithm (1) to obtain LU factorization of A. By note (1) the first m rows 
of L are zeros and the first m columns of U are zeros. Block multiplication 
shows that A can be written as a product of two matrices of the desired form 

A = HV 

with 

H = L[{m + 1 . . . n + m}, {1 . . . n + m}} 

and 

V = U[{1 . . . n + m}, {m + 1 . . . n + m}] 

□ 

Note 6 

Additionally by note (2) last m columns of H are zero and last m rows of V 
are zero. 

Note 7 

Note 4 shows that factorization of A obtained in this way is a full rank 
factorization. 
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Notes about computation of LU factorization in floating 
point arithmetic . 

Every invertible matrix which has an LU factorization has a neighborhood 
in which every matrix is invertible and has LU factorization. Moreover, if 
we require that Ua = 1 then such a factorization is unique. Therefore we 
can define function A \— > [L, U]. Such a function can be defined in some 
neighborhood of any invertible matrix that has an LU factorization. The 
function will be invertible and continuous in the neighborhood. The inverse 
will also be 1-1 and continuous. These facts make it possible to compute LU 
factorization of an invertible matrix satisfying conditions (1) using floating 
point arithmetic. 

However in general a matrix that has an LU factorization does not have 
a neighborhood in which every matrix has an LU factorization. Also if a 
factorization exists it does not have to be unique. Further LU factorization 
does not have to depend continuously on the entries of A. Thus, because of 
the possibility of the rounding error it is not generally possible to compute 
an LU factorization in the general case in floating point arithmetic using 
algorithm (1). 

Some Applications. 

Theorem 6 Any n-by-n matrix A can be written as 

A = U 1 LU 2 

with U\ and U2 upper triangular matrices and L lower triangular matrix. 

Proof. By a series of type-3 elementary row operations matrix A can be 
transformed into a matrix C such that for all k — 1, . . . , n we have 

rankC[{l ...k}] = rankC[{l . . . n}, {1 . . . Jfc}] 

In particular, since 

rankC\{\ . . . k}, {1 . . . n}} < k 

we see that C satisfies conditions (1). In fact one can transform A into C 
using only elementary type-3 row operations that add multiples of ith. row 
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to the jth row with j < i. Any series of such operations can be realized by 
multiplying A by an invertible upper triangular matrix U on the left. We 
have 

C = UA 

but by theorem (1) 

C = LU 2 

with L lower triangular and U 2 upper triangular. Since U is invertible we 
can let 

C/i = U' 1 

That gives us 

UiUA = A = U X LU 2 

□ 

Note 8 

Notice that U\ can be taken invertible. Also because 

rankC[{\ ...k}}= rankC[{\ ... n}, {1 ... k}} 
it follows that L can be taken invertible [ see LM ]. 
Corollary 2 Any n-by-n matrix A can be written as 

A = L X UU 

with L\ and L 2 lower triangular matrices and U an upper triangular matrix. 
Proof. It follows from the fact that A T can be written as 

A T = U 1 LU 2 

with Ui and U 2 upper triangular matrices and L lower triangular matrix. □ 
Note 9 

Notice that U and L 2 can be taken invertible. 
We prove the following well known result 
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Theorem 7 Any n-by-n matrix A can be written as 

A = PLU 

with U an upper triangular matrix, L a lower triangular matrix and P per- 
mutation matrix. 

Proof. Any matrix A can be multiplied on the left by such permutation 
matrix P that matrix 

C = P A 

satisfies the following equality for all k — 1, . . . , n 

rankC[{\ ...k}} = rankC[{\ . . . n}, {1 . . . k}] 
In particular, since 

rankC[{l...k},{l...n}] < k 

we see that C satisfies conditions (1). therefore by theorem (1) C can be 
written as 

C = LU 

with a lower triangular L and an upper triangular U. We let 

P — P^ 1 

That gives us 

A = PP A = PC = PLU 

□ . 

Corollary 3 Any n-by-n matrix A can be written as 

A = LUP 

with U an upper triangular matrix, L a lower triangular matrix and P per- 
mutation matrix. 
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Proof. It follows from the fact that 

A T = P L U 

with Uq an upper triangular matrix, L a lower triangular matrix and Po 
permutation matrix. Indeed, we can write 

A = LUP 

with 

L = Ul 
U = L T 

and 

P = Po 

□ 
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